Santiago Province
Towards Federated Foundation Models: Scalable Dataset Pipelines for Group-Structured Learning Zachary Charles
We introduce Dataset Grouper, a library to create large-scale group-structured (e.g., federated) datasets, enabling federated learning simulation at the scale of foundation models. This library facilitates the creation of group-structured versions of existing datasets based on user-specified partitions, and directly leads to a variety of useful heterogeneous datasets that can be plugged into existing software frameworks. Dataset Grouper offers three key advantages. First, it scales to settings where even a single group's dataset is too large to fit in memory. Second, it provides flexibility, both in choosing the base (non-partitioned) dataset and in defining partitions.
Country:
- North America > United States > Virginia (0.04)
- South America > Chile > Santiago Metropolitan Region > Santiago Province > Santiago (0.04)
- Asia > Myanmar > Tanintharyi Region > Dawei (0.04)
Technology:
- Information Technology > Artificial Intelligence > Natural Language > Machine Translation (0.67)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (0.46)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.46)
Country:
- South America > Chile > Santiago Metropolitan Region > Santiago Province > Santiago (0.04)
- North America > United States (0.04)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- (3 more...)
Technology:
Country:
- Asia > Middle East > Israel (0.66)
- North America > United States > New York (0.30)
- North America > Haiti (0.15)
- (11 more...)
Industry:
- Media > News (1.00)
- Government > Regional Government > North America Government > United States Government (1.00)
Technology:
- Information Technology > Communications > Social Media (1.00)
- Information Technology > Artificial Intelligence > Robots > Autonomous Vehicles > Drones (0.85)
Country:
- Asia > Japan > Honshū > Kantō > Tokyo Metropolis Prefecture > Tokyo (0.14)
- North America > Canada > Ontario > Toronto (0.14)
- Africa > Democratic Republic of the Congo > Kinshasa Province > Kinshasa (0.04)
- (17 more...)
Genre:
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (0.92)
Technology:
Country:
- Asia > China > Guangdong Province > Guangzhou (0.04)
- South America > Chile > Santiago Metropolitan Region > Santiago Province > Santiago (0.04)
- Asia > China > Guangdong Province > Shenzhen (0.04)
Technology:
- Information Technology > Artificial Intelligence > Robots (1.00)
- Information Technology > Artificial Intelligence > Representation & Reasoning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Reinforcement Learning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning (0.68)
Country:
- North America > Canada > Alberta (0.14)
- Europe > United Kingdom > England (0.04)
- Asia > China (0.04)
- (3 more...)
Genre:
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (1.00)
- Overview (0.93)
Industry:
- Law (0.93)
- Banking & Finance > Economy (0.47)
Technology:
Country:
- North America > United States (1.00)
- South America > Chile > Santiago Metropolitan Region > Santiago Province > Santiago (0.04)
- Europe > Spain > Galicia > Madrid (0.04)
- Europe > France > Provence-Alpes-Côte d'Azur > Bouches-du-Rhône > Marseille (0.04)
Genre:
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (1.00)
Industry:
- Health & Medicine (1.00)
- Government > Regional Government > North America Government > United States Government (1.00)
- Education (1.00)
- Information Technology (0.68)
Technology:
Country:
- South America > Chile > Santiago Metropolitan Region > Santiago Province > Santiago (0.04)
- North America > United States > New York (0.04)
- North America > United States > California > Los Angeles County > Long Beach (0.04)
- (4 more...)
Technology:
- Information Technology > Artificial Intelligence > Vision (1.00)
- Information Technology > Artificial Intelligence > Representation & Reasoning (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.69)
Country:
- South America > Chile > Santiago Metropolitan Region > Santiago Province > Santiago (0.04)
- Asia > China > Hong Kong (0.04)
Genre:
- Research Report > Experimental Study (0.93)
- Research Report > New Finding (0.67)
Industry:
- Marketing (0.67)
- Information Technology (0.46)
Technology:
Country:
- North America > United States (0.14)
- South America > Chile > Santiago Metropolitan Region > Santiago Province > Santiago (0.04)
Genre:
- Research Report > Experimental Study (1.00)
- Research Report > New Finding (0.67)
Industry:
- Energy (0.93)
- Health & Medicine > Pharmaceuticals & Biotechnology (0.67)
- Government > Regional Government (0.46)
Technology: